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Abstract. Multicritcrion optimization and Parcto optimality arc fundamen- 
tal tools in economics. In this paper we propose a new relaxation method for 
solving multiple objective quadratic programming problems. Exploiting the 
technique of the linear weighted sum method, we reformulate the original mul- 
tiple objective quadratic programming problems into a single objective one. 
Since such single objective quadratic programming problem is still nonconvex 
and NP-hard in general. By using the techniques of lifting and doubly non- 
negative relaxation, respectively, this single objective quadratic programming 
problem is transformed to a computable convex doubly nonnegative program- 
ming problem. The optimal solutions of this computable convex problem are 
(weakly) Pareto optimal solutions of the original problem under some mild 
conditions. Moreover, the proposed method is tested with two examples and 
a practical portfolio selection problem. The test problems are solved by CVX 
package which is a solver for convex optimization. The numerical results show 
that the proposed method is effective and promising. 

1. Introduction. We consider multiple objective nonconvex quadratic program- 
ming problems as follows 

min F(x) = (Fi(x), F 2 (x), . . . , F p {x)) T 
(MOQP) s.t. Ax = b, 

x>0, 

where Fi(x) = x T QiX + 2cfx and x £ R n is the decision variable. Qi S R nxn , Ci € 
R n , i = l,...,p, A = (ai,a 2 ,...,a m ) T e R mxn and b = (b u b 2 , . . . , b m ) € R m are 
given data. Without loss of generality, Qi is symmetric and not positive semidefinite 
by assumption. 

Multi-objective programming (MOP) also known as multi-criteria optimization, 
is the process of simultaneously optimizing two or more conflicting objectives subject 
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to certain constraints. (MOP) problems are found in many fields, such as facility 
location and optimal detector design [5], image processing [8]. Problem (MOQP) is 
a subclass of (MOP) problem and arises in portfolio selection [16], reservoir optimal 
operation [18] and so on. Problem (MOQP) also can be viewed as an extension of 
multiple objective quadratic-linear programming (MOQLP) problem for which the 
objectives are a quadratic and several linear functions and the constraints are linear 
functions which were studied in [13, 16]. 

Problem (MOP) does not have a single solution that simultaneously minimizes 
each objective function. A tentative solution is called Pareto optimal if it im- 
possible to make one objective function better off without necessarily making the 
others worse off. And problem (MOP) may have many Pareto optimal solutions. 
For solving problem (MOP), the linear weighted sum method is one of the most 
widely used methods. The main idea is to choose the weighting coefficients corre- 
sponding to objective functions. Then, problem (MOP) can be transformed to a 
single objective one, and the Pareto optimal solutions for problem (MOP) could be 
found by solving this single objective problem with the appropriate weights. Am- 
mar [1, 2] investigates problem (MOQP) with fuzzy random coefficient matrices. 
Under the assumption that the coefficient matrices in objectives are positive semi- 
definite, some results are discussed to deduce Pareto optimal solutions for fuzzy 
problem (MOQP). However, many practical problems of this class of problems are 
nonconvcx in general. So, these two methods have certain limitations in practical 
applications. 

Burcr [6] proves that a large class of NP-hard nonconvcx quadratic program with 
a mix of binary and continuous variables can be modeled as so called completely 
positive programs (CPP), i.e., the minimization of a linear function over the convex 
cone of completely positive matrices subject to linear constraints (For more details 
and developments of this technique, one may refer to [4, 6, 7, 14]). In order to 
solve such convex programs efficiently, a computable relaxed problem is obtained by 
approximation the completely positive matrices with doubly nonnegative matrices, 
resulting in a doubly nonnegative programming [7], which can be efficiently solved 
by some popular packages. 

Motivated by the ideas of [6, 7], we propose a new relaxation method for solving 
problem (MOQP) by combining with the linear weighted sum method. First of all, 
in virtue of the linear weighted sum method, we first transform problem (MOQP) 
into a single objective quadratic programming (SOQP) problem over a linearly con- 
strained subset of the cone of nonnegative orthant. Since problem (SOQP) is a 
nonconvcx in general, which is equivalently reformulated as a completely positive 
programming problem, which is NP-hard. Furthermore, a computable relaxed con- 
vex problem for this completely positive programming problem is derived by using 
doubly nonnegative relaxation technique, and resulting in a doubly nonnegative 
programming (DNNP) problem. Based on the characteristics of optimal solutions 
of problem (DNNP), a sufficient condition for (weakly) Pareto optimal solutions for 
problem (MOQP) is proposed. Moreover, the proposed method is tested with two 
examples and a practical portfolio selection problem. The test problems are solved 
by CVX package, which is a solver for convex optimization. The numerical results 
show that the proposed method is effective and promising. 

The paper is organized as follows. In Section 2, we recall some basic definitions 
and preliminaries for (weakly) Pareto optimal solution and the linear weighted sum 
method, respectively. In Section 3, problem (MOQP) is transformed into problem 
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(SOQP) by using the linear weighted sum method. And some optimality conditions 
for problem (MOQP) are established. In order to solve problem (SOQP) effectively, 
problem (SOQP) is equivalently reformulated as a convex problem (CP) which 
is further relaxed to a computable (DNNP) problem in Section 4. In Section 5, 
numerical results arc given to show the performance of the proposed method. Some 
conclusions and remarks are given in Section 6. 

1.1. Notation and terminology. Let = {x G R n : Ax = b, x > 0} be the 

feasible set of problem (MOQP). Let i?" (or -R+ + ) denotes the cone of nonnegative 
(or positive) vectors with dimension n, S n the cone of all nxn symmetric matrices, 
S£ the cone of all n x n symmetric positive semidefinite matrices and (S n ) + the 
cone of all n x n symmetric matrices with nonnegative elements. C* is the cone of 
all nxn completely positive matrices, i.e., 

C* = {X G R nxn : X = z k {z k ) T } U {0}, 

k£K 

where {z k }k£K C i?™\{0}. For two vectors x, y G R n , x a y is a vector in R n 
with xiyi is its z-th component. For a matrix M, diag(M) is a column vector whose 
elements are the diagonal elements of M. Given two conformal matrices A and B, 
A • B — trace(^4 T B). For a given optimization problem (*), its optimal objective 
value is denoted by Opt(*). 

2. Preliminaries. 

2.1. Pareto optimal solutions. In multi-objective optimization with conflicting 
objectives, there is no unique optimal solution. A simple optimal solution may 
exist here only when the objectives are non-conflicting. For conflicting objectives 
one may at best obtain what is called Pareto optimal solutions. For the sake of 
completeness, we restate the definitions of some types of Pareto optimal solutions 
and ideal point from [12]. 

Definition 2.1. A solution x* is said to be Pareto optimal solution of problem 
(MOQP) if and only if there does not exist another feasible solution x G £1 such 
that Fi(x) < Fiix*) for all i = 1, . . . ,p and Fi{x) < Fi(x*) for at least one index i. 

All Pareto optimal points lie on the boundary of the feasible region ft. Often, 
algorithms provide solutions that may not be Pareto optimal but may satisfy other 
criteria, making them significant for practical applications. For instance, weakly 
Pareto optimal is defined as follows. 

Definition 2.2. A solution x* is said to be weakly Pareto optimal solution of 
problem (MOQP) if and only if there does not exist another feasible solution x G fl 
such that Fi(x) < Fi(x*) for alH = 1, . . . ,p. 

Remark 1. A solution is weakly Pareto optimal if there is no other point that 
improves all of the objective functions simultaneously. In contrast, a point is Pareto 
optimal if there is no other point that improves at least one objective function 
without detriment to another function. It is obvious that each Pareto optimal point 
is weakly Pareto optimal, but weakly Pareto optimal point is not Pareto optimal. 

In order to illustrate (weakly) Pareto optimal solution intuitively, two examples 
are given as follows. 
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Example 1. Let £1 = [0,3], and 

,2 { -x + 2, x G [0,1], 

fiW = T + i, *2(z) = { i, ie (1,2], 

(x-l, xe (2,3]. 




Figure 1. Pareto optimal solution set [0, 1] and weakly Pareto 
optimal solution set [0, 2] 

The design space for this problem is shown in Figure 1. According to the above 
two definitions about (weakly) Pareto optimal solution, we can easily get Pareto 
optimal solution set for this problem is [0,1], and weakly Pareto optimal solution set 
is [0,2]. Note that each Pareto optimal solution is weakly Pareto optimal solution 
for this problem, since [0, 1] C [0, 2], this also shows the conclusion holds in Remark 
1. 

Example 2. Let ft = [0,4], and 

F 1 (x) =(x- l) 2 + 2, F 2 (x) = (x - 2) 2 + 1, F 3 (x) = \\x\\. 

For this problem, the graphs for each objective function is plotted in Figure 2. 
By Definitions 2.1 and 2.2, it holds that Pareto optimal solution and weakly Pareto 
optimal solution for this problem are the same, they all equal to [0, 2]. 

2.2. The linear weighted sum method. One useful way of getting the efficiency 
of problem (MOQP) is to build a utility function [17] according to the decision 
makers provided preference information, such that each solution gained by this 
method is Pareto optimal solution of problem (MOQP). 
The linear weighted function 

U (F(.)):=f>F,(.) (1) 

i=l 

is one of the most widely used utility function, where weight A; corresponding to 
objective functions Fi(-), i = 1, . . . ,p satisfy the following conditions 

p 

^Ai = l, A l > 0, i = l,...,p, (2) 

i=l 
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Figure 2. Pareto optimal solution set [0, 2] and weakly Pareto 
optimal solution set [0, 2] 

which is provided by the decision makers, and weights Xi imply that the relative 
importance for Fi(-) in the heart of the decision makers. 

3. Optimality conditions. In this section, we derive a single objective quadratic 
programming (SOQP) problem corresponding to problem (MOQP) by the linear 
weighted sum method. And, some optimality conditions for problem (MOQP) are 
proposed based on the optimal solutions for problem (SOQP). 

From (1) and (2), problem (MOQP) can be convert to a single objective quadratic 
programming problem as follows 

£ X l {x T Q l x + 2cfx) 

i=l 

Ax = b, 
x > 0. 

Similar to Corollary 3.1 in [17], we can get the following theorem, its proof can 
be found in [17]. 

Theorem 3.1. Let x* be an optimal solution for problem (SOQP), it follows thatx* 
is a Pareto optimal solution (weakly Pareto optimal solution) for problem (MOQP) 
if weight X > (X > 0, X ^ 0). 

According to the above Theorem 3.1, varying weight A consistently and contin- 
uously can result in a subset of Pareto optimal (weakly Pareto optimal) set for 
problem (MOQP). The following theorem presents a sufficient optimality condition 
for weakly Pareto solution of problem (MOQP). 

Firstly, we quote the following definition which will be used in the sequel. 

Definition 3.2. Let x £ £1 and Y = F(£i), if there exists a convex set H such that 

Y CH, and H H {F(x) - R p ++ ) = 0, 

then we say that Y satisfies the convex inclusion condition at F(x). 

Based on the above convex inclusion condition, we have the following theorem. 
The proof is omitted here for the reason that it is similar to the one of Theorem 
3.6 in [17]. 




min 

(SOQP) 
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Theorem 3.3. Let x* be a weakly Pareto optimal solution for problem (MOQP), 
and Y satisfies the convex inclusion condition at F(x*). Then there exists a weight 
A > 0, A ^ such that x* is an optimal solution for problem (SOQP) with A. 

In particular, if problem (MOQP) is convex, Theorem 3.3 still holds without the 
convex inclusion condition. 

4. Reformulation. Note that problem (SOQP) is a nonconvex quadratic program- 
ming problem in general, and thus it is NP-hard. If problem (SOQP) is convex 
with appropriate coefficient A, we may use some popular convex packages to solve 
it directly. In the following section, we will establish the computable convex refor- 
mulation for problem (SOQP) when it is nonconvex, and the details are as follows. 

4.1. Completely positive reformulation. Motivated by the ideas in [6], problem 
(SOQP) can be reformulated as a completely positive programming problem. First, 
the definition of completely positive [3] is given as follows. 

Definition 4.1. A symmetric matrix B of order n is called completely positive if 
one can find an integer m and a matrix V of size n x m with nonnegative entries 
such that B — VV T , where the smallest possible number m is called the CP-rank 
of B. 

Based on above definition for completely positive, by using the techniques in [6], 
problem (SOQP) can be reformulated as the following completely positive program- 
ming problem 

min J2 \{Qi*X + 2cJx) 

i=l 

di&g{AXA T ) = bob, 
1 x T 



which is a convex programming problem. Similar to Theorem 2.6 in [6], the following 
theorem holds immediately, for more details can be seen in [6]. 

Theorem 4.2. Opt(SOQP) = Opt(CP), and if (x*,X*) is an optimal solution for 
problem ( CP), then x* is in the convex hull of optimal solutions of problem (SOQP). 

According to Theorem 4.2, problem (SOQP) is equivalent to problem (CP). How- 
ever, problem (CP) is NP-hard, since there is a cone C*, n constraint, and check 
whether or not a given matrix belong to C* +n is shown to be NP-hard [10], one 
must relax it in practice. Relaxing problem (CP) in a natural way yields a doubly 
nonnegative programming (DNNP) problem. 

4.2. Doubly nonnegative relaxation. As mentioned above, in order to estab- 
lish the doubly nonnegative relaxation for problem (CP), the definition of doubly 
nonnegative is given as follows. 

Definition 4.3. If matrix Z £ S n is not only nonnegative but also positive semi- 
definite, then Z is called doubly nonnegative. 

Note that if Z £ C*, it necessarily holds that Z is doubly nonnegative from the 
above Definitions 4.1 and 4.3. Moreover, the convex cone S£ is self-dual, and so 
is the convex cone (S n ) + . Hence, Diananda's decomposition theorem [9] can be 
reformulated as follows. 
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Theorem 4.4. For all n, we have C* C S+ n (5n) + - T/ie relationship " D " /or 
two sets ZioWs «/ and only if n < A. 

Regardless of the dimension n, one always has the inclusion C* C 5+ n (S n ) + . 
Of course, in dimension n > 5 there are matrices which are doubly nonnegative but 
not completely positive. The counterexample 

110 1 
12 10 
12 10 

12 1 
10 16 

proposed by Diananda [9] to illustrates this point . 

Replacing C* +n by S^ +n n (5i +n ) + according to Theorem 4.4, problem (CP) is 
relaxed to the following doubly nonnegative programming problem 

mm £ \i(Qi»X + 2cJx) 
»=i 

1 x T 



X 



e S 1+n n (5i + „) 



+ 



which is not only a convex problem but also can be solved in polynomial time to 
any fixed precision from the theory of interior-point methods. 

Up to now, problem (MOQP) is reformulated as above problem (DNNP), which 
can be solved by some popular package CVX. It is obviously that problem (DNNP) 
is a relaxation form for problem (MOQP). 

In the last of this section, we will investigate the relationship between optimal 
solutions for problems (MOQP) and (DNNP), i.e., a sufficient condition for (weakly) 
Parcto optimal solutions of problem (MOQP) based on the characteristics of optimal 
solutions for problem (DNNP) is established in the following part. 

Theorem 4.5. Let {x* ,X*) be an optimal solution for problem (DNNP). If the re- 
lationship X* = x*(x*) T holds, then Opt(DNNP) = Opt(CP). Moreover, (x*,X*) 
is an optimal solution for problem (CP). 

Proof. On one hand, from Theorem 4.4, it is obviously holds that 

Opt(CP) > Opt(DNNP). (3) 

On the other hand, from X* = x*(x*) T , and constraints of problem (CP), we have 
(x*,X*) is also a feasible solution for problem (CP). Since problems (DNNP) and 
(CP) have the same objective function, it follows that 

p 

Opt(CP) < J2 X i(Qi • x * + 2c I x *) = Opt(DNNP). (4) 

i=i 

Thus, combining (3) and (4), we have 

Opt(CP) = Opt(DNNP). 

Again from problems (CP) and (DNNP) have the same objective function, it holds 
that (x*,X*) is an optimal solution for problem (CP). □ 
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Remark 2. It holds that Opt(SOQP) = Opt(CP) from Theorem 4.2. Let (x*,X*) 
be an optimal solution for problem (DNNP), if X* = x*(x*) T , by Theorem 4.5, we 
have Opt{CP) = Opt(DNNP). Thus, we get Opt(SOQP) = Opt(DNNP) under the 
condition X* = x*(x*) T . Furthermore, since problems (SOQP) and (DNNP) have 
the same objective function, again from Theorem 4.2, we can conclude that x* is 
an optimal solution for problem (SOQP). From Theorem 3.1, we further know that 
x* is a Pareto optimal solution (or weakly Pareto optimal solution) for problem 
(MOQP) if A > (or A > 0). 

5. Numerical experiments. In this section, in order to show the effectiveness of 
our proposed method, some examples are tested and corresponding numerical results 
are reported. To solve test problems, we use CVX [11], a package for specifying and 
solving convex programs. The software is implemented using MATLAB R2011b on 
Windows 7 platform, and on a PC with Intel(R) Core(TM) i3-2310M CPU 2.10 
GHz. 

In the following numerical experiments, three examples are solved by using the 
proposed method, respectively. The first example is a given two-dimension prob- 
lem, which has four nonconvex objective functions. The second example is a five- 
dimension nonconvcx problem with five objective functions. Note that its coeffi- 
cients are generated by MATLAB function randn(-). The last example is a practi- 
cal portfolio selection problem, which is taken from [16]. The weighted coefficient 
A is generated by the following procedure 

lambda=zeros(p, 1); 

while lambda(p)==0 

lambdad :p-l)=rand(p-l , 1) ; s=sum (lambda) ; 

if s<l lambda(p)=l-s ; end 

end 

where p is the number of objective functions. 

Example 3. First of all, a two-dimension problem with four objective functions is 
tested. The corresponding coefficients Qi, Ci, i = 1,...,4 and A, b are given in 
Table 1. 



Table 1. Coefficients for Example 3 



Qi = 


1 3 




2 




2 




-1 




3 8 


Q2 = 


-2 


Q 3 = 


2 


Qi = 








a = [2.5 -0.5]' 1 ' c 2 = [-1 -1.5] 1 ' c 3 = [1 0.5]' J c 4 = [1 1.5]' J 



A = [1 1] b = 1 



First, by relative simple computation, we obtain optimal solutions for each ob- 
jective function which is minimized independently. The corresponding optimal nu- 
merical results of each objective function are given in Table 2. 



Table 2 . Optimal numerical results for each objective function of 
Example 3 





F 2 (x') 


F 3 (x") 


Fi(x") 


FV 5.6667 


-5 




1 


x* (0.6667 0.3333) T 


(0 1) T 


(oi) T 


(1 0) T 
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In Table 2, the labels FV and x* denotes optimal values and optimal solutions 
corresponding to each objective function, respectively. The results in Table 2 show 
that the objective functions F2(x) and Fs(x) have the same optimal solution, which 
is different from the other two functions optimal solutions. These imply that we 
can not find a single solution that simultaneously optimizes each objective function. 
Moreover, note that these four optimal solutions corresponding to each objective 
function are all weakly Parcto optimal solutions for Example 3. 

Table 3. Optimal numerical results for Example 3 in (DNNP) 



(0.5472 0.1386 0.1493 0.1649) 


" 5.8345 " 
-2.8494 
2.4106 

. 2.3849 . 


[ 0.4301 
[ 0.5699 


[ 0.1850 0.2451 ] 
[ 0.2451 0.3248 J 


(0.3500 0.1966 0.2511 0.2023) 


" 7.0000 " 
-5.0000 
1.0000 
3.0000 




0.0000 
1.0000 


[ 0.0000 0.0000 
[ 0.0000 1.0000 




(0.0759 0.0540 0.5308 0.3394) 


" 6.0000 " 
0.0000 
2.0000 

. 1.0000 . 


[ 1.0000 
[ 0.0000 


[ 1.0000 0.0000 
|_ 0.0000 0.0000 




(0.2417 0.4039 0.0965 0.2579) 


" 5.6670 " 
-1.6105 
2.5513 

. 1.8625 . 


[ 0.6779 
[ 0.3221 


r 0.4596 0.2183 
[ 0.2183 0.1037 




(0.5752 0.0598 0.2348 0.1302) 


" 5.8570 " 
-2.9261 
2.3857 
2.4132 


[ 0.4148 
[ 0.5852 


[ 0.1720 0.2427 
[ 0.2427 0.3425 




(0.0430 0.1690 0.6491 0.1389) 


" 7.0000 
-5.0000 
1.0000 
3.0000 




0.0000 
1.0000 


[ 0.0000 0.0000 
[ 0.0000 1.0000 




(0.2259 0.1707 0.2277 0.3757) 


" 6.0000 " 
0.0000 
2.0000 

. 1.0000 . 




1.0000 
0.0000 


[ 1.0000 0.0000 
|_ 0.0000 0.0000 




(0.2920 0.4317 0.0155 0.2609) 


" 5.7480 " 
-2.4901 
2.5020 
2.2460 




0.5020 
0.4980 


[ 0.2520 0.2500 
[ 0.2500 0.2480 




(0.2607 0.5944 0.0225 0.1224) 


" 5.7480 " 
-2.4901 
2.5020 
2.2460 


[ 0.5020 
[ 0.4980 


[ 0.2520 0.2500 1 
[ 0.2500 0.2480 J 



It is very easy to verify that the given four objective functions are all noncon- 
vex by using MATLAB function eig. Furthermore, we obtain problem (SOQP) 
is nonconvex with corresponding coefficients A which proposed in Table 3 by us- 
ing eig. Hence, we use our method to solve this problem. The corresponding 
optimal numerical results are reported in Table 3. In Table 3, Example 3 is trans- 
formed into problem (DNNP), and then is solved with nine different weighted co- 
efficient A. The results of x* and X* in Table 3 show that X* = x*(x*) T holds 
for nine different weighted coefficients. Thus, from Theorem 4.5 and Remark 2, 
it holds that each optimal solution x* in Table 3 also is Parcto optimal solution 
for Example 3. Moreover, we obtain weakly Pareto optimal solutions for Exam- 
ple 3 when the weighted coefficient A is chosen appropriately. For instance, if A 
is chosen as (0.3500,0.1966,0.2511,0.2023) or (0.0430,0.1690,0.6491,0.1389), then 
weakly Pareto optimal solution (0.0000, 1.0000) T is obtained by using our method. 
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Example 4. In this test problem, we set n = 5, m = 4 and p = 5. The corre- 
sponding coefficients Qi, Ci, i = 1, . . . , 5 and A, b are generated by the functions 
tril (randn(n,n) , -l)+triu(randn(n,n) ' ,0) , randn(n, 1) , randn(n,m) and 
randn (m , 1 ) . respectively, and the details can be seen in Table 4. 

Table 4. Coefficients for Example 4 



0.4056 

-1.4193 

-0.7294 

1.1473 

0.5979 



-1.4193 

-2.2033 

-0.5712 

0.2140 

0.9424 



-0.7294 

-0.5712 

0.3062 

-1.1723 

-0.9610 



1.1473 

0.2140 

-1.1723 

-0.9000 

-0.2857 



0.5979 

0.9424 

-0.9610 

-0.2857 

0.6103 



0.7907 
0.2877 
0.0032 
0.3656 
3.5267 



0.0591 

-1.4669 

-1.6258 

-1.9648 

2.6052 



-1.4669 

0.2570 

-0.9742 

-1.1464 

0.5476 



-1.6258 
-0.9742 
-0.4494 
-0.0843 
-1.9920 



-1.9648 
-1.1464 
-0.0843 
-0.3909 
0.4092 



2.6052 

0.5476 

-1.9920 

0.4092 

1.3018 



-0.1124 

-1.5566 

1.9151 

0.6098 

-0.6479 



-0.5936 

0.4364 

-0.5044 

0.1021 

1.1963 



0.4364 

-1.0368 

-0.8571 

-0.1699 

-0.1917 



-0.5044 

-0.8571 

1.2665 

-0.2512 

-0.2046 



0.1021 

-0.1699 

-0.2512 

-0.3862 

0.5256 



1.1963 

-0.1917 

-0.2046 

0.5256 

0.8175 



2.6173 

0.5510 

0.2942 

-0.7778 

-1.0649 



0.4902 

0.7653 

0.7783 

-1.4803 

0.5404 



0.7653 

-0.7603 

-0.6936 

1.2815 

-0.8097 



0.7783 

-0.6936 

2.0108 

0.0256 

0.3083 



-1.4803 

1.2815 

0.0256 

0.5301 

-0.9521 



0.5404 

-0.8097 

0.3083 

-0.9521 

-0.4506 



-1.7684 

-0.4229 

-1.0531 

0.6478 

-0.3176 



0.1092 

-0.2506 

-0.1899 

-1.0329 

-0.3233 



-0.2506 

1.7447 

-1.1605 

2.3774 

1.5261 



-0.1899 

-1.1605 

-0.6987 

0.8328 

-0.6946 



-1.0329 

2.3774 

0.8328 

0.8967 

0.5047 



-0.3233 

1.5261 

-0.6946 

0.5047 

1.1867 



1.7690 

1.5106 

0.1640 

-0.2828 

1.1522 



-1.1465 
0.6737 
-0.6691 
-0.4003 



-0.6718 
0.5756 
-0.7781 
-1.0636 



0.5530 
-0.4234 
0.3616 
-0.3519 



0.2695 
-2.5644 
0.4659 
1.8536 



1.0393 
0.9109 
-0.2397 
0.1810 



0.2442 
0.0964 
-0.8305 
-0.3523 



In order to verify that whether the given objective functions in Table 4 are 
nonconvex functions or not, the corresponding eigenvalues for Qi, i = 1, . . . , 5 are 
given in Table 5. The results in Table 5 show that five objective functions are all 
nonconvex. Thus, we will use the proposed method to solve this problem. The 
results arc given in Tables 6 and 7. 

Table 5. Eigenvalues for Qi, i = 1, . . . , 5 in Example 4 



Quadratic matrices 


Eigenvalues 




Qi 


(-3.3892, - 


1.8503, -0.0780, 1.1180, 2.4184) 


Q2 


(-4.2248, - 


1.8386, 0.7234, 1.3339, 4.7837) 


Qs 


(-1.6777, - 


1.1336, -0.3917, 1.1973, 2.0731) 


Qi 


(-2.5335, - 


1.0738, 0.6848, 1.6750, 3.0677) 


<2s 


(-2.3512, - 


0.6382, 0.1606, 1.3837, 4.6838) 



Table 6 shows that the optimal numerical results for each objective function of 
Example 4. The results in Table 6 show that we can not find a single solution 
that simultaneously optimizes these five objective functions. Note that these five 
optimal solutions are also weakly Pareto optimal solutions for Example 4. 

Note that wc can verify that problem (SOQP) is nonconvex with seven different 
choices of weighted coefficient A which show in Table 7. So, Example 4 can be 
solved by using the proposed method. The results of x* and X* in Table 7 show 
that X* = x*(x*) T holds for these seven different cases of weighted coefficient A. 
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Table 6. Optimal numerical results for each objective function of 
Example 4 





FV 


X 


Fi(z*) 


2.1900 


(0, 1.2165, 0.2253, 0.4747, 0.7783) J 


F 2 (x*) 


-9.2542 


(2.7216, 0. 2.7773, 0.7727, 1.5592) J 




-1.3755 


(0, 1.2165, 0.2253, 0.4747, 0.7783)' J ' 


F 4 (x*) 


-2.2276 


(0.4915, 0.9969, 0.6861, 0.5285, 0.9193) J 


F 5 (x') 


0.6759 


(2.7216, 0,, 2.7773, 0.7727, 1.5592) J 



Table 7. Optimal numerical results for Example 4 in (DNNP) 



A FV x* x 





" 0.3317 " 
0.1522 
0.3480 
0.1217 
0.0464 




" 2.1900 " 
-1.7656 
-1.3755 
-1.7914 
7.0248 




" 0.0000 " 
1.2165 
0.2253 
0.4747 
0.7783 




" 0.0000 0.0000 0.0000 0.0000 0.0000 " 
0.0000 1.4799 0.2741 0.5775 0.9469 
0.0000 0.2741 0.0508 0.1070 0.1753 
0.0000 0.5775 0.1070 0.2254 0.3695 
0.0000 0.9469 0.1753 0.3695 0.6058 






" 0.0712 " 
0.1820 
0.0930 
0.4635 
0.1903 




" 2.2944 
-2.3834 
0.1927 
-2.2196 
6.2356 




" 0.4250 " 
1.0266 
0.6238 
0.5213 
0.9003 




" 0.1806 0.4363 0.2651 0.2215 0.3826 " 
0.4363 1.0538 0.6403 0.5351 0.9242 
0.2651 0.6403 0.3891 0.3252 0.5616 
0.2215 0.5351 0.3252 0.2717 0.4693 
0.3826 0.9242 0.5616 0.4693 0.8105 






" 0.0290 " 
0.6371 
0.0595 
0.1692 
0.1052 




" 2.3045 " 
-2.4426 
0.3234 
-2.2257 
6.1681 




" 0.4595 " 
1.0111 
0.6562 
0.5251 
0.9102 




" 0.2111 0.4646 0.3015 0.2413 0.4182 " 
0.4646 1.0224 0.6635 0.5309 0.9203 
0.3015 0.6635 0.4305 0.3445 0.5972 
0.2413 0.5309 0.3445 0.2757 0.4779 
0.4182 0.9203 0.5972 0.4779 0.8284 






" 0.0472 " 
0.0559 
0.0715 
0.0157 
0.8098 




" 3.5136 " 
-9.2542 
9.9301 
6.7545 
0.6759 




" 2.7216 " 
0.0000 
2.7773 
0.7727 
1.5592 




" 7.4071 0.0000 7.5586 2.1030 4.2434 " 
0.0000 0.0000 0.0000 0.0000 0.0000 
7.5586 0.0000 7.7132 2.1460 4.3302 
2.1030 0.0000 2.1460 0.5971 1.2048 
4.2434 0.0000 4.3302 1.2048 2.4310 






" 0.1911 " 
0.0504 
0.5484 
0.0095 
0.2006 




" 2.1900 
-1.7656 
-1.3755 
-1.7914 
7.0248 




" 0.0000 " 
1.2165 
0.2253 
0.4747 
0.7783 




" 0.0000 0.0000 0.0000 0.0000 0.0000 " 
0.0000 1.4799 0.2741 0.5775 0.9469 
0.0000 0.2741 0.0508 0.1070 0.1753 
0.0000 0.5775 0.1070 0.2254 0.3695 
0.0000 0.9469 0.1753 0.3695 0.6058 






" 0.2166 " 
0.6291 
0.0149 
0.0433 
0.0961 




" 3.5136 " 
-9.2542 
9.9301 
6.7545 
0.6759 




" 2.7216 " 
0.0000 
2.7773 
0.7727 
1.5592 




" 7.4071 0.0000 7.5586 2.1030 4.2434 " 
0.0000 0.0000 0.0000 0.0000 0.0000 
7.5586 0.0000 7.7132 2.1460 4.3302 
2.1030 0.0000 2.1460 0.5971 1.2048 
4.2434 0.0000 4.3302 1.2048 2.4310 






" 0.2583 " 
0.0041 
0.0905 
0.5958 
0.0513 




" 2.2080 
-1.8738 
-1.0651 
-1.9303 
6.8716 




" 0.0857 " 
1.1782 
0.3057 
0.4841 
0.8029 




" 0.0073 0.1010 0.0262 0.0415 0.0688 " 
0.1010 1.3882 0.3601 0.5704 0.9460 
0.0262 0.3601 0.0934 0.1480 0.2454 
0.0415 0.5704 0.1480 0.2344 0.3887 
0.0688 0.9460 0.2454 0.3887 0.6447 





Hence, we can conclude that each x* in Table 7 also is Pareto optimal solution for 
Example 4. Furthermore, compare the results of FV and x* in Tables 6 and 7, note 
that some weakly Pareto optimal solutions of Example 4 can be obtained by using 
our method. For example, if A = (0.3317,0.1522,0.3480,0.1217,0.0464), then we 
obtain weakly Pareto optimal solution (0.0000, 1.2165, 0.2253, 0.4747, 0.7783) T for 
Example 4. 

Remark 3. The results for Example 3 and Example 4 imply that we not only obtain 
Pareto optimal solutions, but also obtain some weakly Pareto optimal solutions for 
original problem with appropriate choices of weighted coefficient A. Summarizing 
these results, we can conclude that our method is effective for solving some problems 
(MOQP). 
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Example 5. (Portfolio Selection Problem) This problem is taken from [16]. It 
is a practical portfolio selection problem in which objective function F(x) has the 
following expression 

F ( x ) = {-jX T Qix, -c%x, ~cJx) T , 

where symmetric matrix Qi is called the risk matrix, C2 denotes the return rate 
vector, C3 is a given weighting vector and its element is a function of corresponding 
security liquidity. The corresponding coefficients are given in Table 8. 

Table 8. Coefficients for Example 5 



Qi = 



- 12.35 


-8.64 


9.88 


-8.43 


9.42 


-1.47 


4.29 


-0.96 


15.2 


-1 


-8.64 


6.42 


-8.15 


5.13 


4.56 


5.83 


-6.72 


0.78 


3.42 





9.88 


-8.15 


18.27 


-8.14 


2.32 


-4.12 


-1.85 


1.34 


0.795 





-8.43 


5.13 


-8.14 


12.6 


-8.43 


7.47 


-4.67 


-0.679 


8.09 





9.42 


4.56 


2.32 


-8.43 


17.07 


7.33 


-3.18 


-0.547 


0.323 





-1.47 


5.83 


-4.12 


7.47 


7.33 


13.38 


-3.84 


-0.478 


0.616 





4.29 


-6.27 


-1.85 


-4.67 


-3.18 


-3.84 


3.41 


0.107 


0.464 





-0.96 


-0.78 


1.34 


-0.679 


-0.547 


-0.478 


0.107 


1.33 


11.23 





15.2 


3.42 


0.795 


0.809 


0.323 


0.616 


0.464 


11.23 


2.45 





. 


























. 



C2 = 


[11.11 


17.78 


2.22 18.28 12.6 10.15 6.72 5.75 6.1 2.25]' J 


c 3 = 


[0.069 


0.092 


0.046 0.096 0.086 0.068 0.06 0.145 0.151 0.197] J 


A = 


[1111 


111 


111) 6 = 1 



Note that the objective functions contain only one quadratic function ^x T Q±x, 
by using eig function of MATLAB, it is easy to verify that function \x T Q\x is 
nonconvex. Thus, we use the proposed method to solve this problem. The corre- 
sponding optimal results are given in Table 9. 

Table 9. Optimal numerical results for Example 5 



"X" Fv ? 





0.3482 
0.1655 
0.4863 




0.1894 

-15.6800 

-0.0850 


(0.3240, 0.5567, 0.0000, 0.1194, 0.0000, 0.0000, 0.0000, 0.0000, 0.0000. 0.0000) T 




0.5141 
0.1931 
0.2927 




0.1320 

-15.5462 

-0.0846 


(0.3433, 0.5466, 0.0000, 0.1101, 0.0000, 0.0000, 0.0000, 0.0000, 0.0000, 0.0000) T 




0.6167 
0.3087 
0.0746 




0.2026 

-15.7070 

-0.0851 


(0.3200, 0.5590, 0.0000, 0.1210, 0.0000, 0.0000, 0.0000, 0.0000, 0.0000, 0.0000) T 



In Table 9, Example 5 is solved with three different values of weight A. The 
first element and the absolute value of the second element of FV in Table 9 denote 
the expectation risk and return, respectively. The results in Table 9 show that 
we obtain the lower risk and higher return when weight A is chosen appropriately. 
Moreover, we also compare with the results in [16], which arc show in Table 10. 



Table 10. Optimal numerical results for Example 5 in [16] 



FV 


X 




0.6823 






-7.5079 


(0.0453, 0.0706, 0.0273, 0.0703, 0.078, 0.045, 0.0534, 0.169, 0.1665, 0.2746) T 




-0.1343 
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The results of FV in Tables 9 further imply that the risk and return are more com- 
parable with the results in Table 10. For example, when A = (0.3482, 0.1655, 0.4863), 
we obtain lower risk 0.1894 and higher return 15.6800, which are more comparable 
with the results of [16] 0.6823 and 7.5079, respectively. Furthermore, note that the 
optimal solutions x* obtained by using our method are sparse, which imply that we 
mainly focus on some kinds of important stocks. Hence, we can put together the 
limited money, and invest these money in some of important stocks to obtain more 
satisfied return with lower risk. 

We also notice that there are infinite choices of weight A, and not all choices of 
weight A are reasonable for each investor. How to select weight A to lower risk and 
higher return depends on the investors's preference. Therefore, it is reasonable that 
investors participate in decision making and continuously revise their preferences 
according to practical conditions. This also shows that our method is promising in 
solving portfolio selection problems. 

6. Concluding remarks. In this paper, a class of (MOQP) problems is discussed. 
By using the linear weighted sum method to deal with quadratic objective functions, 
problem (MOQP) is transformed into problem (SOQP), which is nonconvex in gen- 
eral. Then, taking advantage of lifting techniques, problem (SOQP) is equivalcntly 
reformulated as problem (CP) which is a convex programming problem but NP- 
hard in general. A computable relaxed convex problem (DNNP) for problem (CP) 
is obtained by using doubly nonnegative relaxation method. Moreover, based on 
the characteristics of optimal solutions for problem (DNNP), a sufficient condition 
for (weakly) Pareto optimal solutions for problem (MOQP) is proposed. Finally, 
the numerical results of two problems and a practical portfolio selection problem 
show that the proposed method is effective and promising. 
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